System and Method for Using an Internet Appliance to Send/Receive 
Digital Content Files as E-mail Attachments 

Related Applications: 

5 This patent application is related to each of the following U.S. patent applications and 
provisional patent applications, all filed on July 8, 2001 , and under an obligation of 
assignment to UNIQA, Inc.: U.S. Provisional Patent Application for 'Voice Annotation 
System and Method," Attorney Docket No. UNIQA-0023-P; U.S. Provisional Patent 
Application for "Method and Apparatus for Dynamically Changing A User Interface In An 
1 0 Internet Appliance," Attorney Docket No. UNIQA-0026-P; U.S. Patent Application for 
q "System and Method for Internet Appliance Data Entry and Navigation," Attorney Docket 

5 No. UNIQA-0028; U.S. Provisional Patent Application for "System and Method for Peer-to- 

6 Peer Exchanges of Digital Content Files Using An Internet Appliance," Attorney Docket No. 
J UNIQA-0029-P; and U.S. Provisional Patent Application for "System and Method for 

95- Password Generation and for Digital Certificate Creation and Authentication," Attorney 
= Docket No. UNIQA-3234-P. This patent application is also related to each of the following 
H provisional patent applications, all filed on July 1 1 , 2000, and under an obligation of 
O assignment to UNIQA, Inc.: U.S. Provisional Patent Application No. 60/217,626 for "Internet 
p Appliance for Interactive AudioA/ideo Display Using A Remote Control Unit for User Input"; 
^0 U.S. Provisional Patent Application No. 60/217,627 for "Fax-Compatible Internet 

Appliance"; and U.S. Provisional Patent Application No. 60/217, 628 for "WEB Browser 
Implemented In An Internet Appliance Using A Remote Control Unit for User Input." 

Field of the Invention: 

25 The present invention pertains to the field of data communication through email, and more 
specifically to a method for sending and receiving data files, images, and audio (digital 
content) files via an Internet appliance using a TCP/IP based electronic mail protocol. 

Background of the Invention: 

30 Access to the Web has thus far been limited to people who have access to a personal 

computer. Yet many people cannot afford the cost of even a relatively inexpensive personal 
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computer, while others are unable or unwilling to learn the basic computer skills that are 
required to access the Web. Furthermore, Web browsers in the prior art generally do not 
provide the degree of user-friendliness desired by some people who lack computer 
experience, and many computer novices do not have the patience to learn how to use the 
5 software. Some people, for example, dislike an interface that requires them to identify 
hypertext objects and use the point-and-click technique to browse through Web pages. 

Most people, however, feel quite comfortable using a remote control to operate a television 
set. Therefore, it would be desirable to provide a means by which a person can access the 
r ;40 World-Wide Web without the use of a personal computer. In particular, it would be 
*5 desirable for a person to be able to access and navigate through Web pages using an 
5 ordinary television set and a remote control. It would further be desirable to have a user 
l! S interface by which a person can use a remote control to navigate between hypertext 
O objects on a Web page with minimal effort or thought, so that a person feels more as if he 
"15 or she is simply changing television channels rather than utilizing a complex computer 
H network. 

S There is a need for a person having access to an Internet appliance having a simple user 

interface for exchanging digital content files, such as data files, images, and audio files, 
20 with other Internet users. 

Summary of the Invention: 

That need, and others that will become apparent, is met by the present invention which, in 
a preferred embodiment, defines a method for exchanging digital content files as standard 
25 email attachments. 

An embodiment of the invention includes innovations in the field of content provision and an 
extension of the album features of Imagia™, namely Mail Albums. Another embodiment 
permits a list of MIME formatted attachment files to be sent via email. A user is not required 
30 to write file names and email addresses using a console, as done in conventional mail send 
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clients. A server implemented Mail Receive module acts as a virtual client for all users of 
the POP server and fetches emails for them. The mail is not presented directly to the 
clients. Instead of using a conventional mailbox system, all valid attachment files are 
generated from the mails and are stored in a directory structure. This directory structure is 
5 maintained within a system server and acts as a virtual mailbox for the clients, which holds 
only attachment files and mail body files, but not the raw mails. Clients gather their mails 
from this directory structure. The client experiences an extension of the Gallery and Albums 
feature we name Mail Album. 

CJO The claimed invention is an electronic communication method for Internet appliances 
S especially EdenBox™ (hereafter "Internet appliance"). Using the invention, users can send 
0 and receive mails for Internet appliances or on the Internet. The invention requires physical 
lc servers and storage facilities, customized to serve the invented protocol. When a mail is 
O received for an EdenBox™ client, the mail is broken down to separate the body of the mail 
-15 and its attachments. The body and the attachments are MIME decoded if needed and 
3 saved as files. These files are stored in the EdenBox™ clients' directories, namely My 
5 Album. When the clients use the UNIQA™ EdenBox™ Internet appliance, the user can see 
5 the received mail and its attachments as items in the clients' Mail Album. EdenBox™ and 
^ UNIQA™ are trademarks of UNIQA, Inc. 
20 

The EdenBox™ user can send items that can be browsed through the Internet appliance. 
When the user mails items, the items are attached with the mail and sent to the recipients. 
The recipients can be Internet appliance users or general users who have access to the 
Internet. 

25 

The invention differs from the standard electronic mail methods in the following ways: 

• The method is customized for Internet Appliance EdenBox™ users. 

• No physical data items are transferred from the Internet appliances to the recipient 
while sending the mail. 
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• A command is passed to the server that the Internet appliance is connected to, in 
order to send mail. The sever takes action according to the command and transfers 
the files accordingly. 

• When mail is received the server again processes the mail to split the body and the 
attachments, and stores them in the client's directory. The server also prepares the 
files so that the Internet appliance user can view it. 

All mail sending and receiving procedures are highly configurable since configuration files 
control the policy of the protocol. 

Brief Description of the Drawings: 

FIG. 1 is a process flow diagram illustrating a mail send procedure according to one aspect 
of the present invention. 

FIG. 2 is a block diagram that illustrates command parsing for the mail send module. 
FIG. 3 is a block diagram that illustrates mail handling procedures for the mail send 
module. 

FIG. 4 is a functional block diagram that illustrates a mail receive process. 

FIG. 5 is a simplified view of a user interface screen display for "My Site." 

FIG. 6 is a simplified view of a user interface screen display of available email. 

FIG. 7 is a simplified view of a user interface screen showing the body of a selected email 

message. 

FIG. 8 is a simplified view of a user interface screen showing available email attachments. 

FIG. 9 is a layout view of a typical reduced keyset user interface device for use with an 

Internet appliance according to another aspect of the invention. 

FIG. 10 is a simplified view of a Send dialog box. 

FIG. 1 1 is a simplified view of a Send E-mail dialog box. 

FIG. 12 is a simplified view of an Existing E-mail Address list. 

FIG. 13 is a front panel view of an Internet appliance (EdenBox™) used with the present 
invention. 

FIG. 14 is a view of a back panel of an Internet appliance (EdenBox™) used with the 
present invention. 
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FIG. 15 is a simplified view of an E-mail text entry screen with alphabet entry selected. 
FIG. 16 is a simplified view of the E-mail text entry screen with number entry selected. 
FIG. 17 is a simplified view of the E-mail text entry screen with special symbol entry 
selected. 

5 FIG. 1 8 is a simplified view of the E-mail text entry screen with shortcut entry selected. 
FIG. 19 is a pictorial diagram that illustrates a digital content file exchange system using 
email attachments according to one aspect of the present invention. 

Description of the Preferred Embodiment: 

!lo The disclosures of each patent application and provisional patent application listed in the 
S Related Applications section, above, are incorporated by reference herein. 

£ FIG. 1 9 - An Overview 

ill FIG. 19 is a pictorial diagram that illustrates a digital content exchange system using email 
Cf 5 attachments according to one aspect of the present invention. The system is designated 
^ generally by the reference numeral 1 900. The system 1 900 includes access to a 
I communications network 1 902, such as the Internet, and access via the network to a mail 
H server (POP server) 1 906. The system 1 900 also includes a proprietary network service 

(UNIQA System) 1904. The proprietary network service 1904, and the mail server 1906 are 
20 interconnected via the communications network 1 902 for exchanging email and email 

attachments. 

The proprietary network service 1904 is more specifically defined in related US patent 
applications and provisional patent applications, and includes a server (UNIQA server) 
25 1 908, and a plurality of Internet Appliances (EdenBox™) 1 91 0 - 1 914, all interconnected 
via the communications network 1902. Each Internet appliance 1910-1914 appears as a 
client with respect to the UNIQA server 1 908, while the UNIQA server 1 908 appears as a 
client to the mail server 1 906. 
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In a specific embodiment, all digital content files within the UNIQA system 1904 reside in 
storage at the UNIQA server 1908, and are available in TV-HTML format to a browser 
within each Internet appliance. The digital content files are not stored at the Internet 
appliances. Digital content files are typically video, still photograph, and audio files, but 
5 other digital content files are also within the scope of the invention. 

To send one or more digital content files that are already stored at the UNIQA server 1908, 
the user identifies the files and the intended file recipient's email address. This information 
is forwarded to the UNIQA server 1908 from the user's Internet appliance. The UNIQA 
10 server 1908 locates the selected file(s) within its file storage (not shown) and creates an 
email listing the files and providing the intended recipient's address. The mail message is 
forwarded from the UNIQA server 1908 to the mail server 1906 via the communications 
network using standard TCP/IP protocols. The digital content files portion is forwarded to 
the mail server using the file transfer protocol FTP:// so that the transfer can be conducted 
' 5 by the UNIQA server 1 908 in background mode to permit rapid server response to other 
Internet appliance requests. 

Digital content files requested by an Internet appliance user are first sought within the 
UNIQA server storage. When not available in storage, the UNIQA server 1908 uses email 
20 procedures in an attempt to locate the requested file on the Internet 1 902. When the 

requested file is successfully returned to the UNIQA system 1904 by the mail server 1906, 
the file is identified as an attachment to an email. The UNIQA server 1908 obtains the 
digital content file(s) from the mail server 1906 using the file transfer protocol FTP://, to 
provide greater task scheduling flexibility, as described above. Once the requested digital 
25 content file(s) have been transferred, the UNIQA server 1 908 separates the email and the 
attached file, stores the file in server storage, and after file formatting for delivery as a TV- 
HTML document, notifies the requesting user via the user's Internet appliance. 

The invention is divided in to two main parts. The first part is a Mail Send Module used to 
30 send email and attached digital content files from one Internet appliance to another, and to 
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email addresses beyond the UNIQA system 1904. The second part is a Mail Receive 
Module used by an Internet appliance to request digital content files stored on the UNIQA 
server 1908 but owned by a different appliance or user, and to request digital content files 
located beyond the UNIQA system 1904. The two modules are software components 
located at the UNIQA server 1908, and taken together describe the underlying architecture 
of the invention. The invention also defines a protocol for digital content file exchanges 
using email attachments. 

FIG's 1 - 3, A Mail Send Module 

The Mail Send module, as illustrated in Figurel , compromises the steps of: 

• Methods to send email to another Internet appliance especially EdenBox™ users 
as standard emails. 

• Methods to have the option to send images to other persons using general email 

• All images that the user wants to send will be sent as one or more attachments of 
an email. 

• The mail body and subject of the email will be empty. 

• The mail will have only one receiver. 

• The user interface on the client side will initiate the email process 

• The process of termination of mail send will end by sending all data to a standard 
SMTP server. 

In order for a user to send the images, audio or any other data files: 

• The said data files must reside in the server with which the said Internet appliance 
(EdenBox™) maintains its storage. 

• Data files that the user wants to send also reside in a subdirectory of the said 
server. So that the client side software can send only the name of the target files 
and receiver email address to the server to send the email. 

• When a user selects data files, image files and also all associated audio files, their 
names are entered in a text file. The target email address is also entered in that 
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text file. A separate thread is created to prepare and send this generated text file to 
the Uniqa© server. The same thread also waits for the server confirmation. 
• When the file is ready, the file is sent to the server using a FTP connection. At the 
same time, a mail send request will be sent to the server side command processor. 

FIG. 1 is a process flow diagram illustrating a mail send procedure according to one aspect 
of the present invention. The mail send procedure is designated generally by the reference 
numeral 100 and includes a client side 102, a UNIQA server side 104, an SMTP server 
106, and an intended file receiver 108. 

A user selects images to be sent and provides a recipient's ("target") email address, 
message creation process 110. The client side 102 defines an Internet appliance. The 
created message is sent 1 12 via a communications network to the UNIQA server side 104. 
A server side file selection process 114 copies all files requested by the message to a send 
subdirectory (not shown), and requests a mail send module. A server side mail send 
module 116 establishes a connection via the communications network with an SMTP mail 
server 106. The mail send module 116 prepares the mail body, and sends 118 all 
requested files to the SMTP server. The SMTP server 106 processes the mail and attached 
data files and delivers these to the intended receiver 108. 

FIG. 2 is a block diagram that illustrates command parsing for the mail send module. The 
parsing process is designated generally by the reference numeral 200, and includes a 
server side command processor 202, a client side socket creation process 204, a delete- 
all-files process 206, a UNIQA server side socket creation process 208, and a UNIQA 
server file encoding and transmission process 21 0. 

The user Internet appliance creates an email message defining user owned/controlled files 
to be deleted from the UNIQA server file storage, or alternatively defining user 
owned/controlled files located at the UNIQA server file storage to be transmitted to the 
intended recipient. The Internet appliance creates a socket connection 204 with the UNIQA 
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server and sends the email request. The UNIQA server (1908 of FIG. 19) parses the 
request and determines that it is a mail delete request, or alternatively a mail send request 
214. 

5 The UNIQA server deletes 206 user owned/controlled files located at the server storage in 
response to a mail delete request. The UNIQA server response to a mail send request 214 
is to create a socket connection 208 with the SMTP mail server. The UNIQA server MIME 
encodes all requested user owned/controlled files stored at the UNIQA server storage. The 
encoded files are transferred to the SMTP server using a file transfer protocol. The 
CJO transferred files are treated by the mail SMTP mail server as email file attachments. 

5 FIG. 3 is a block diagram that illustrates mail handling procedures for the mail send 

J module. The mail handling procedures are designated generally by the reference numeral 

O 300. The procedures 300 provide additional details of the server side command processor 

£jk ii 

S J5 202 of FIG. 2. 

9 A sender module 302 at an Internet appliance sends an email file request message to the 
□ UNIQA server (1 908 of FIG. 1 9). A request parsing process 304 determines whether the 
^ request is a mail delete request , or alternatively a mail send request. A mail delete request 
20 initiates a file location process within the UNIQA server. When a file to be deleted has been 
located, the file is deleted 312 from the UNIQA server file storage, and file maintenance 
records are updated 314 by the UNIQA server. When a mail send request 308 is 
recognized, a Validation step 316 validates all information from the client relating to the 
request. Next, an Address Manipulation step 318 formats the intended recipient address if 
25 the user provided recipient address contains dot-formatted IP address information. Next, a 
socket connection is established 320 with an SMTP mail server, and the mail send module 
sends all email and initialization handshaking commands. Next the mail send module 
generates an email header 322, including unique multi-part boundary information. Finally, 
the mail send module Fetches and Sends all Attachments at step 324 The attachment files 
30 are, one by one MIME encoded using the BASE64 method and sent to the SMTP Server. 
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In a specific embodiment, the encoded files are transferred to the mail server using a 
standard file transfer protocol FTP://. The use of the standard file transfer protocol permits 
the file transfers to take place in background mode so that the UNIQA server can be more 
responsive to individual Internet appliance 1910 requests and needs. 

5 

Once an email request is sent 1 12 from an Internet appliance 1910, the request is received 
at the UNIQA server 1908. A mail service runs continuously at the UNIQA server side 104. 
Whenever there is a request received from an Internet appliance, the request generates a 
new requested information in a local log file. One line of information is created in the log file 
Q0 for each requesting email. The Internet appliance creates a socket connection with the 
% UNIQA server to communicate with the UNIQA server's command processor module. A 
P wait interval of predetermined duration is created for obtaining a mail status report. In a 
lp successful process, a mail confirmation is received during this wait interval. There are two 
H types of confirmation: success and failure. When a confirmation (success or failure) is 
M 5 received from the SMTP mail server, the result is written in a log file maintained by the 
5 UNIQA server. However, before receiving the confirmation there may be a possibility of a 
2 time out. While waiting for the confirmation if the predefined duration of confirmation is 
O over, i.e., the process times out, or when the confirmation arrives after the predefined wait 
*° interval has terminated, a failure message is generated and is entered into the log file 
20 maintained by the UNIQA server. Thus all status for the mail starting from the request till 
the confirmation is stored in the UNIQA server log file. 

After receiving the mail send request and the mail information text file from a client, the 
command processor will spawn a new thread. This thread creates a new mail send 
25 subdirectory in the client's data directory, which is stored in the Internet appliance's storage 
management server. The text file is parsed to find 

• Which files are to be sent 

• Who is the recipient of the files 
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It will then copy all the mentioned data files, e.g., image files, audio files, etc., to the newly 
created send subdirectory. The data files will be given a new name in the new directory 
irrespective of their original names. If the data files are images, the new name will be 1.jpg, 
2.jpg, etc. no matter what their original names were. 

5 

Once the mail send subdirectory is created, a socket connection is created to communicate 
with the mail send module described. This mail module will listen to a predetermined socket 
port, which is configurable in the configuration file, for connections from the server 
command processor module described earlier. As soon as a connection is established, a 
f=|0 new thread will be created and the mail send request will be accepted. After that, the mail 
f send module will create a connection 320 with the intended SMTP server. Then a standard 
5 mail header will be created 322. The mail header contains all necessary fields for a 
t standard email header. The mail header is then sent to the SMTP server. After that, all the 
O files are MIME encoded using, in a specific embodiment, the BASE64 method and sent to 
*1 5 the SMTP server as part of an email attachment, one encoded file after another. When the 
P transaction ends successfully, the mail send module sends a success response to the 
O calling module. When any error occurs, the mail send module sends a failure response to 
n the calling module. However when the status confirmation, i.e., success or failure, arrives 
^ after the previously described predefined mail timeout duration, the mail process for that 
20 session is treated as a failure and the log is updated accordingly. 

The mail send module, as illustrated in FIG. 2 and FIG. 3, is responsive to a predetermined 
socket port for connections from the UNIQA server 1908 command processor module, as 
previously described. As soon as a socket connection is established 1 16, 320, a new 

25 thread is created and the mail send request is accepted. After that, the mail send module 
creates a connection with the intended SMTP server. After receiving this information, the 
thread creates a socket connection with the SMTP server on port 25. The SMTP server 
1906 is same machine, or alternatively is a different machine. The mail send module then 
sends all mail header specific commands over the established connection. In a specific 

30 embodiment, the mail header is a standard mail header. 
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The mail header contains all standard fields such as "From", "To", "MIME version", 
"Boundary", etc. After the header is created, the requested image and audio files are 
opened one after another to MIME encode their contents and send over the socket 
connection. In a specific embodiment, the BASE64 method is used to MIME encode the 
files. File names are changed to the format as described above in the header for each file's 
attachment. The given original file names are not used. After all files have been sent, the 
connection with the SMTP server is closed and a response is sent to the UNIQA server 
side 104 command processor. 

In another specific embodiment, the mail send module 300, shown in FIG. 3, has another 
functionality in addition to sending email. The mail send module 300 also provides a facility 
for deleting specified email from a user's mail album directory. A delete mail request 306 
arrives from the UNIQA server side 104 command processor and includes the user's name 
and a number representing the specific email to be deleted. The mail send module 300 
creates a child process for this operation, and the child process deletes all the files 
associated with the identified email. The reason that a child process is created instead of a 
thread is that the mail delete system function cannot be run from a thread. 

This mail send module will have an interaction with two modules, the server side command 
processor and the mail receive module (not shown). The UNIQA server side command 
processor creates a socket connection to a predetermined port to send either a send mail 
or a delete mail request to the mail send module 300. The mail send module is responsive 
to this port for connections from the UNIQA server side command processor. Parameters 
for both of these commands have been mentioned above. 

Interaction with the mail receive module involves a configuration file. In a specific 
embodiment, each user will has one configuration file. This file contains only two numbers. 
The first one is the number of mails currently residing in the mail album directory and it 
cannot be more than the predefined maximum number for allowed mails. The second 
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number is the serial number of the latest mail. This second number increases as new mails 
arrive and previously used numbers are not reused. The second number defines a mail 
serial counter and will continue to increase as new email is received. In a specific 
embodiment, eight bytes are used for this number, thus there is no realistic risk of counter 
5 overflow. Both the mail send module and the mail receive module attempt, independently, 
to create an interlock file before opening the configuration file so that only one mail process 
can work with the configuration file at a time. When the mail send module deletes an email, 
it decreases the first counter 314 saved in the configuration file. 

lo With respect to FIG. 3, the Sender Module 302 receivers a request from a user. A test is 
| made 304 to determine whether the request is a mail delete request 306 or a mail send 
5 request 308. When the request is a delete mail request 306, a Find File step 310 locates 
£ mail related files in the client (user) data directory. A Delete File step 31 2 deletes all files 
m related to an email (if any). Finally, an Update Bookkeeping step 314 updates internal 
!j 5 bookkeeping, as described above. 

y FIG's 4 - 8, A Mail Receive Module 

p Mail is received in the Internet Appliance EdenBox™, where 

• The user has mail album facility in the users Internet appliance, EdenBox™. 
20 • The user has a directory in the Uniqa™ Central Database Server (UCDS), 

hereafter referred to as UCDS (what has been referred to previously as the UNIQA 
server 1908, FIG. 19, and the UNIQA server side 104, FIG. 1). 

• All emails received for a particular user, reside in the user's mail album directory. 

• Each received email is listed as items of the mail album shown in FIG. 5. 

25 • Attachments of the email are displayed in the attachment list for that particular 

email, as shown in the FIG. 6 and FIG. 7, in the mail album 

• The naming scheme for emails and their attachments is discussed in the later part 
of this description. 
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In the Internet Appliance, EdenBox™ a user can see the emails in a mail album shown in 
FIG. 4. FIG. 4 also shows a user interface of the EdenBox™ Internet appliance (1910, FIG 
19). When a user enters the mail album, as illustrated in FIG. 5, the user is able to see 
his/her available email. When a new mail is ready in the user's server (UCDS) mail album 
directory, a New Mail Received message is sent to the user's Internet appliance from the 
UCDS. 

FIG. 5 is a simplified view of a user interface screen display for a "My Site" user interface 
display screen. The display screen is designated generally by the numeral 500 and 
includes a split selection bar 502, 504, a navigation bar 506, thumbnails 508, and a status 
bar 510. To select the option "My Site" the user enters a reduced keyset keystroke 
sequence by pressing the numbered key "2". Doing so causes the "My Site" option to be 
highlighted (not illustrated). 

FIG. 6 is a simplified view of a user interface screen display of available email. The user 
interface display screen is designated generally by the numeral 600, and includes a split 
election bar 602, 604, a navigation bar 606, a received email display window 608, and a 
blank status bar 610. 

FIG. 7 is a simplified view of a user interface screen showing the body of a selected email 
message, and is designated generally by the numeral 700. The user interface display 
screen 700 includes a split election bar 702, 704, a navigation bar 706, a window 708 
displaying the body of a selected received email, and a status bar 710. 

FIG. 8 is a simplified view of a user interface screen showing available email attachments 
and is designated generally by the numeral 800. The user interface display screen 800 
includes a split election bar 802, 804, a navigation bar 806, a window 808 displaying 
received email attachments, and a status bar 810. 
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FIG. 6 illustrates a user interface within the mail album. The interface permits the user to 
select a specific email. Thumbnail views of file attachments are displayed along with the 
listed emails. The body of the mail is shown in FIG. 6. The attachment part of an email is 
shown in FIG. 8. When there is an audio attachment, a stylized thumbnail is associated 
5 with it. 

The first picture 812 in FIG. 8 shows a thumbnail version of a sent image. The second 
image 814 showing waves represents (not illustrated as described) an audio attachment. 
Whenever an audio is attached to an email, a stylized thumbnail showing sound waves or 

QO indicating sounds is displayed. Selection of the sound waves attachment enables the user 

3 to listen to the attached sound file. 

2 FIG. 4 is a functional block diagram that illustrates a mail receive process (mail receive 

5 module). The process is designated generally by the reference numeral 400 and includes a 
*J 5 checking for mail step 402, a query step 404 for determining whether new users have 

3 logged onto the system, a test 406 to determine whether a user can download mail, a step 
1 408 for downloading all mail files for a user, a housekeeping step 41 0, a test 41 2 to 

O determine whether an email includes multi-part boundary information, a step 414 for 
l= processing multi-part boundary emails, a step 41 6 for reading and decoding the email body 
20 information, a step 41 8 for parsing email attachment files, a step 420 for reading 

attachment headers, a test 422 to determine whether the attachment type is supported by 
the UNIQA server, a bypass step 424 for non-supported attachment types, a step 426 for 
supported attachment decoding, and a step 428 for attachment file renaming. 

25 The mail receive module 400 polls 404 for the client list of each logged on Internet 
appliance from the user database. In a specific embodiment, the polling is repeated at 
predetermined intervals every 24 hours. The predetermined polling interval is configurable 
by a UNIQA system 1904 administrator, and is done in order to receive newly logged on 
user information, and also user information for new users. During this polling for user 

30 information, the mail receive modules obtains : 
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• A user ID 

• A user login password. 

All user information is encrypted at the Internet appliance (see related provisional patent 
application, Docket No. UNIQA-3234) while being transferred and the user information is 
also kept encrypted while being processed. 

The mail receive module functions as a daemon module. After a predetermined and 
system-administrator-configurable interval, the mail receive module connects to the SMTP 
server and checks mail 406 for all clients (again, "client", "user", and "Internet appliance" 
are used interchangeably unless otherwise stated: a user accesses the UNIQA system 
1904 via an Internet appliance 1910, and each Internet appliance 1910 - 1914 has a client 
relationship with the UNIQA server 1908). When mail is available for any client, the mail 
receive module 400 downloads all emails for that client 408 in a temporary file. Then a mail 
process module 410 is called. The mail process module 410 separates all the emails and 
from each email, all the attachment(s), data file(s), image and audio files are collected. Also 
when any mail body text is available, the text is copied 416 into a separate text file. The 
image and audio files arrive as attachments, and must be MIME decoded and stored 426 in 
individual image and audio files. The decoded files are copied 428 to the available mail 
directory of the client's data directory in the UNIQA server 1908. In a specific embodiment, 
each mail server contains, at most, a predefined maximum number of attachment files. 

As discussed earlier, the mail receive module daemon 400 makes a new socket connection 
with the POP mail server 1 906 after a predefined interval. The mail receive module 400 
connects to the POP server 1906 and checks mail for all clients 402. When email is 
available for any client, all available email for the client is downloaded into separate mail 
files at the UNIQA server 1908. It should be noted that a client downloads a maximum of 
files only, that maximum being the difference of the maximum allowed mail number and the 
number of existing mails. The mail receive module 400 then collects all the image and 
audio files. As these files are MIME encoded in the attachment area of the email, they will 
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be MIME decoded before extracting the attachment file contents. Supported standard 
MIME encoding systems include BASE64, Quoted Printable, binary and UUencode. 

Once all the email for the Internet appliance is downloaded 408, the mail process module 
5 starts parsing the mails 41 0 for each client respectively. When any mail body text is 

available, it is copied 416 into a separate text file. When no mail body exists, a 0-byte file is 
created, and hence there is always a file created 416 for each mail received. The mail 
process then determines whether there is an attachment 418. As the image and audio files 
will come as attachments, they must be MIME decoded 426 and then stored in individual 
Jo image and audio files. All these files are copied to the predefined mail directory of the 
2 client's data directory in the server. There will be only one of the said predefined mail 
2 directory for a user and all the mail files will be stored there. A mail file name will reflect the 
f file serial number in the particular mail and also the mail number in the mail directory so 
5 that it is possible to detect which file belongs to which mail 428. For example, image files 
S J5 for the third mail should be named 3.1 .jpg, 3.2.jpg and so on. The second number indicates 
H the file serial number in the third mail and the first number is the mail serial number (3rd in 
{j this case). The mail body text file is named 3.txt for the third mail. 

The received emails contain any number of image and audio files as attachments in any 
20 order. Using the configuration file, one can configure which type of data file attachment will 
be copied and which type of attachment {i.e., data file) is to be discarded. Any mail without 
a single valid attachment type will be discarded. If a user already has a maximum number 
of mails, the users mails will not be fetched from the POP server. 

25 An Internet Appliance 

An Internet appliance (FIG's 13, 14) is a small device that includes a processing unit; a 
wired or wireless network connection section such as a modem for communication with a 
network; a video section including a video signal output, such as a television interface for 
outputting video and audio signals, or separate video and audio signal outputs, and a user 
30 interface signal receiver for receiving user interface signals (a reduced keyset keystroke 
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sequence) from a reduced-keyset user interface device, such as a consumer-type remote 
control unit. The above components are preferably contained in a housing or provided on 
the outside surface of the housing to form an integral unit. The processing unit is connected 
to the network connection section, the video section and the user interface signal receiver 
5 and controls all functions of the Internet appliance. 

A reduced keyset user interface device is a device that has a small number of keys and 
transmits a small number of keystroke signals associated with the keys. As used in this 
specification, the term "reduced-keyset user interface device" does not include a device 

10 that has a full text-entry keyboard. FIG. 9 illustrates a reduced keyset user interface device 

^ configured as a remote control unit. 

2 The video section of the Internet appliance can be connected to a display such as a 
£ television for displaying information, and the Internet appliance unit typically does not have 
V\5 its own video display or other graphic display devices in the interest of reducing the device 
□ size. The user interface signal receiver is the only device for receiving user interface 
y information from the user (via the reduced-keyset user interface device), and the Internet 
5 appliance unit does not have its own keyboard input device with text-entry keys. The lack of 
H an integral video display device and a keyboard allows the Internet appliance to have a 
20 compact structure. User interface is provided solely through the cooperation of the video 
display and the reduced-keyset user interface device. 

Several features may be added to most Internet appliances, although not required, 
including: an audio output, an audio input, a video input, and visual indicators for monitoring 

25 system readiness and receipt of new email messages. These features may be actual input 
and output devices such as a speaker, a microphone, and a video camera that are housed 
in the housing, if they can be made sufficiently compact. Alternatively, there are input and 
output signal terminals provided on the housing for connecting with external devices such 
as speakers, microphones and video or digital cameras (USB connector 9). The audio and 

30 video inputs are used to capture and store voice and image information from the user. The 
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audio output may be used to produce a user-feedback sound such as a beep or click each 
time a user key press on the user interface device is received and processed. If a key press 
is received but ignored because it is currently invalid, the user interface remains silent or 
makes a different (error) sound. The visual indicators, such as an LED panel, are typically 
5 provided on the housing for providing the user with visual indications of system statuses. 

The Internet appliance according to embodiments of the present invention cooperates with 
a reduced-keyset user interface device to accomplish all user interface functions. As used 
in this specification, the term "reduced-keyset user interface device" refers to an input 
40 device having a small number of numeric, direction (arrow) and function keys that 
S generates a small set of keystroke signals. The term reduced-keyset user interface device 
5 does not include a device that has a full text-entry keyboard. In this specification, the 
*i description "a small number of keys" is understood to mean a set of ten numeric keys, a set 
0 of four direction keys, and a limited number (such as 3-5) of function keys. An example of a 
rl5 reduced-keyset user interface device is a consumer-style remote control unit. Another 
Q example is the keypad of a cellular phone. In other words, cellular phones, which have 
0 infrared and/or radio frequency transmitters and receivers, may be used to interact with an 
S Internet appliance. 

20 FIG. 9 illustrates a layout of a typical reduced-keyset user interface device, designated 
generally by the numeral 900. The reduced keyset user interface device 900 includes a set 
of ten numeric keys 901 - 910, four arrow or direction keys (Up 920, Down 922, Left 924, 
and Right 926), a Pound key ("#") 928, a Star key ("*") 930, a Select key 932, and an 
On/Off toggle key (POWER) 934. This preferred layout of 18 keys is optimized for ease of 

25 use and operation. This key set has the additional advantage that it is very similar to the 
keypad found on cordless telephone handsets (such as the Star and Pound keys). Of 
course, the keys on the user interface device, especially the function keys such as the 
Pound, Star and Select keys (12, 13 and 14), may be labeled differently without affecting 
the basic function of the user interface device. In addition, more or fewer keys may be 

30 used, and auxiliary keys such as Shift, Control or Alt keys may be provided to expand the 
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number of keystroke signals. A keystroke input device satisfies the requirement of a 
reduced-keyset user interface device according to the present invention so long as it has 
relatively few function keys and does not have a full set of text-entry keys. Further, 
depending on application, the reduced-keyset user interface device may be a wireless or 
5 wired device, or integrally provided on the housing of the Internet appliance. 

For example, for fax-compatible appliances to be used in shared environments (like an 
office), it may be preferable to provide the user input keypad directly on the housing of the 
appliance, rather than having a separate "remote control" type input device. This minimizes 
iO the risk that the user input device is separated from the appliance and lost. 

S A graphical user interface (GUI) that enables a user to fully interact with an Internet 

^ appliance using a reduced-keyset user interface device is described in commonly assigned, 

S co- pending patent application entitled "Internet Appliance Using a Reduced-Keyset User 

w i5 Interface Device," which is incorporated herein by reference in its entirety. 

C An Internet appliance has a network connection section and is preferably connected to a 
network. A networked Internet appliance may be referred to as a "client device", and 
information may be processed by a multitude of servers on the Internet. The local client 
20 device has information processing capabilities, but it typically requires resources on the 
Internet to accomplish a large part of its functions. An Internet appliance, however, is 
typically able to perform certain information processing functions even when the network 
connection is inactive. The term Internet appliance is not intended to be limited to devices 
having any particular network connection configuration, and includes devices that are 
25 stand-alone for at least a part of the time. 

A typical network connection is to the Internet, but other types of network may also be 
used, such as an Intranet. For internet appliances that connect to the network using a 
modem, an Internet Service Provider (ISP) is typically employed to provide the hardware 
30 and software infrastructure that provides the link between the modem in the appliance and 
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the other systems on the network to which it connects. The Internet appliance is connected 
to a local telephone exchange office via a telephone line. An ISP AP/POP (Access Point/ 
Point of Presence) is connected to the local telephone exchange office via a multi-line 
telephone service and to the internet backbone via a digital network connection such as Tl, 
T3 or T5 lines. An Internet appliance network connection using a telephone modem is 
suitable for appliances that operate with fax systems, but the category of Internet appliance 
devices are not limited to those employing a modem for their network connection. Any 
network connection technology, wired or wireless, may be employed by an Internet 
appliance. 

Example: Sending Digital Content Via Email 

1 . Press "2" on the remote control unit ("RCU") (FIG. 9) to move to the MYSITE mode. 
The first view you see is the Album Selection View, which displays the first four 
albums available. If you do not see the album of your choice in this view, highlight 
the "NEXT" link (512 of FIG. 5) and press SELECT 932. 

2. Use the RCU arrow keys 920 - 926 to move the highlight (FIG. 5) to the album you 
want to enter and then press SELECT. 

3. The Multiple Picture View will now be displayed, with the first six pictures of the 
album. If the picture you want to send by e-mail is not on display, highlight the next 
link of pictures "7-12" or "Next" and press SELECT. Continue this until you see the 
picture you want to send. 

4. Move the highlight to the picture of your choice. Then use the arrow keys to move 
the highlight to the "Send" icon link and press SELECT. 

5. A dialog box appears (FIG. 1 0), listing three choices for you. Since you want to e- 
mail the picture, press the associated number key of the RCU (in this case "1") and 
then press "#". 

6. Another dialog box appears (FIG. 1 1 ), asking you to choose whether to send the 
picture to an existing e-mail address or to send it to a new one. To send the picture 
to an existing address, press the associated number key "1". 
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7. A list of e-mail addresses appears (FIG. 12). Use the UP or DOWN keys to select an 
address and then press "#". The address now appears in the e-mail dialog box (1102 
of FIG. 11). Press "#" once more and your mail is sent! 

8. If you want to send the picture to a new address, press the associated number key 
for the new address button. Refer to the section "Creating and Editing an Email 
Message", below, for the process to enter a new address. 

9. Once done, press "#". The address you entered now appears in the e-mail dialog 
box (1 102 of FIG. 11). Press "#" once more and your mail is sent. 

If your mail was successfully delivered, you will not receive any confirmation message. 
You will only receive a confirmation message in case of an unsuccessful mail 
delivery attempt. 

Example: Creating and Editing An Email Message 

Before going into details, it must be remembered that one cannot assign a name containing 
underscore or spaces for a new album in the Create New Album command. However, all 
combinations of letters, digits, spaces and underscores are supported for sending mails. 
For convenience, the user interface supports some of the popular mail domain extensions 
corresponding to numeric keys. 

A simple example for entering the necessary text for sending an email follows. If, for 
instance, the mail address is ubik 24@uniqa.com then the text entry operation would be: 
1 . Type the corresponding numeric key of the relevant alphabet. In this example, the 

letters 'ubik' are input by pressing the following key sequence on the hand-held 

reduced keyset user input device (FIG. 9): 

u=82 b= 22 i= 43 k=52 

FIG. 15 illustrates a text entry user interface display screen, designated generally by 
the numeral 1500. The screen 1500 includes selection bars 1502, 1504, a text entry 
("mail field") window 1506, an alphabet letter selection display 1508, an input mode 
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selection bar 1510, a control button template indicated generally by the numeral 
1512, and a status bar 1514. 

That is, the corresponding key for u is 82. So press '8' followed by '2' to get the 
character 'u' in the mail field. Similarly press '22' for 'b', '43' for 7, '43' for 'k\ 

2. For the underscore, press SELECT on your RCU to move the cursor to highlight 
SYMBOLS 1516, and there (FIG. 17) you will find the underscore character 
corresponding to the numeric '6'. 

3. For the remaining digital number '24' pertaining to the mail address, once again 
press SELECT on the RCU to go to DIGITS 1 702 (bringing up the Numbers screen, 
FIG. 16) and press '2' followed by '4'. 

4. For the symbol '@' once again you will find the symbol in SYMBOLS (FIG. 17). From 
the Numbers screen, use the RCU SELECT key to highlight SYMBOLS 1602. At the 
SYMBOLS screen press the RCU key '2' for the '@' symbol. 

5. Now for the remaining domain part. At the SYMBOLS screen (FIG. 17), press 
SELECT on the RCU until the LETTERS label is highlighted. Then at the Letters 
screen, use the numeric keypad of the RCU to enter the letter sequence 'uniqa'. 
Then use the SELECT key to highlight the SHORTCUTS label. This keystroke 
sequence brings up the SHORTCUTS screen (FIG. 18). Since '.com' is a common 
domain extension, we have the shortcut ready for you in the SHORTCUT section. 

6. Just press "1" on the RCU for the ".com" extension and your mail address is 
complete! In case the shortcut of the extension is not available, you will have to 
follow the usual way of typing the text as just described above. 
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In case of any correction you need to make, you can always erase by pressing the UP key 
on the RCU, and un-erase by pressing the DOWN key. 

5 While the invention has been described in relation to the embodiments shown in the 
accompanying Drawing figures, other embodiments, alternatives and modifications will be 
apparent to those skilled in the art. It is intended that the Specification be exemplary only, 
and that the true scope and spirit of the invention be indicated by the following Claims. 
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